Papers with unsupervised text style transfer
Counterfactuals to Control Latent Disentangled Text Representations for Style Transfer (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for unsupervised text style transfer focus on transferring a specific attribute, but this technique has never been explored in natural language generation tasks. |
| Approach: | They propose a counterfactual-based method to modify latent representations by posing a ‘what-if’ scenario. |
| Outcome: | The proposed method is tested on multiple attribute transfer tasks like Sentiment, Formality and Excitement to support the hypothesis. |
Fighting Offensive Language on Social Media with Unsupervised Text Style Transfer (P18-2)
Copied to clipboard
| Challenge: | Existing methods to tackle the problem of offensive language in social media are based on machine learning. |
| Approach: | They propose a method for training encoder-decoders using non-parallel data . they use a collaborative classifier, attention and the cycle consistency loss . |
| Outcome: | The proposed method outperforms state-of-the-art text style transfer systems on Twitter and Reddit . it produces reliable non-offensive transferred sentences, the authors show . |
NAST: A Non-Autoregressive Generator with Word Alignment for Unsupervised Text Style Transfer (2021.findings-acl)
Copied to clipboard
| Challenge: | Autoregressive text style transfer models often ignore part of the source sentence and generate some irrelevant words with strong styles. |
| Approach: | They propose a non-autoregressive generator for unsupervised text style transfer which explicitly models word alignments to suppress irrelevant words. |
| Outcome: | The proposed generator significantly improves performance and provides explainable word alignments. |
How Positive Are You: Text Style Transfer using Adaptive Style Embedding (2020.coling-main)
Copied to clipboard
| Challenge: | Existing approaches for unsupervised text style transfer are disentanglement between content and style. |
| Approach: | They propose to separate a model with a sentence reconstruction module and a style module to improve model architecture. |
| Outcome: | The proposed method improves style transfer performance and content preservation . the proposed method can be used to modify a sentence with a specified style attribute . |
Cycle-Consistent Adversarial Autoencoders for Unsupervised Text Style Transfer (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for unsupervised text style transfer lack parallel data and difficulties in content preservation. |
| Approach: | They propose a neural approach to unsupervised text style transfer using non-parallel data. |
| Outcome: | The proposed approach can be trained end-to-end on two widely-used public datasets. |
RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning (2022.emnlp-main)
Copied to clipboard
Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric Xing, Zhiting Hu
| Challenge: | Existing methods for finding the optimal prompt for a task are difficult to optimize. |
| Approach: | They propose an efficient discrete prompt optimization approach with reinforcement learning that generates the optimal discrete stimulus after training with reward. |
| Outcome: | The proposed approach is based on a parameter-efficient policy network that generates the optimal discrete prompt after training with reward. |
Learning Implicit Text Generation via Feature Matching (2020.acl-main)
Copied to clipboard
Inkit Padhi, Pierre Dognin, Ke Bai, Cícero Nogueira dos Santos, Vijil Chenthamarakshan, Youssef Mroueh, Payel Das
| Challenge: | Generative feature matching networks are an approach for training implicit generative models for images . a novel formulation of GFMN for unconditional sequence generation is proposed . |
| Approach: | They propose a new GFMN formulation that performs token level feature matching on pre-trained neural networks. |
| Outcome: | The proposed method outperforms adversarial approaches for text generation and style transfer. |
Hard Prompts Made Interpretable: Sparse Entropy Regularization for Prompt Tuning with RL (2024.acl-long)
Copied to clipboard
Yunseon Choi, Sangmin Bae, Seonghyun Ban, Minchan Jeong, Chuheng Zhang, Lei Song, Li Zhao, Jiang Bian, Kee-Eung Kim
| Challenge: | Prompt tuning is an important technique for directing model behaviors and eliciting desired responses. |
| Approach: | They propose to find optimal prompt tokens using soft Q-learning to optimize models for prompt tuning. |
| Outcome: | The proposed method improves on baseline prompt tuning, and the results are more natural and interpretable. |
Collaborative Learning of Bidirectional Decoders for Unsupervised Text Style Transfer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for unsupervised text style transfer struggle to achieve high style conversion rate and low content loss. |
| Approach: | They propose a collaborative learning framework for unsupervised text style transfer using a pair of bidirectional decoders. |
| Outcome: | The proposed framework achieves strong empirical results on style compatibility and content preservation. |
Exploring Non-Autoregressive Text Style Transfer (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text style transfer use autoregressive decoding, but they are slow and low parallelizability. |
| Approach: | They propose a base NAR model by directly adapting the common training scheme from its AutoRegressive counterpart. |
| Outcome: | The proposed model sacrifices performance due to lack of conditional dependence between output tokens . knowledge distillation, contrastive learning, and iterative decoding are employed to improve the model . |
Prefix-Tuning Based Unsupervised Text Style Transfer (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Unsupervised text style transfer is an important task in computer vision and natural language processing. |
| Approach: | They propose a method that uses pre-trained large language models to train a generative model that can alter the style of the input sentence without using any parallel data. |
| Outcome: | The proposed method outperforms the state-of-the-art methods on well-known datasets. |